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Method and apparatus for image processing. 

The invention relates to a method and apparatus for processing images. More 
specifically, the invention is concerned with detecting and identifying specific 
features or types of features in images, and classifying objects and regions in 
images. 

The invention is especially useful for the detection of man-made structures in 
images, which has applications, for example, in photo-interpretation, 
cartography and surveillance. 

Methods of identifying features such as lines and edges in images are known. 
Simple methods of linking edges into object boundaries are also known, but 
these are generally successful only for relatively simple scenes. It is also 
known to use model-based techniques for identifying specific features in 
images, but these techniques require prepared reference models, which may 
not necessarily be available for all features. Other approaches attempt to infer 
3-D structure, but are often not reliable and may require multiple views of a 
scene. 

Furthermore, it is especially difficult to detect man-made structures and urban 
areas in images, for a number of reasons. For example, contrast between 
buildings and surrounding structures can be very low, causing low-level 
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segmentation and edge extraction to be fragmented. In adcition, small 
structures, such as cars, trees or rocks adjacent to large structures, such as 
buildings, can cause further problems at a segmentation stage and give rise to 
noisy and perturbated, or phantom boundaries. The problem is often further 
5 complicated by the existence of shadows and markings. 

In the specification, references to an image include a whole image and a 
region of an image. 

10 Aspects of the invention are set out in the accompanying claims. 

According to a first aspect of the invention, there is provided a method of 
analysing an image comprising performing a Hough transform on points in an 
image space to an n-dimensional Hough space, selecting points in the Hough 
15 space representing features in the image space, and analysing m of the n 
variables for the selected points, where m is less than n, to derive information 
about the features in the image space. 

More specifically, feature points in an image are extracted, for example, using 
20 feature detecting means such as an edge or corner detector, or other similar 
feature detecting means. The feature points undergo the Hough transform, 
and the image of the feature points in the Hough space are analysed. 



As a result of the invention it is possible to draw more reliable conclusions 
about features in images. The technique does not require a model of a 
structure and handles boundary and segmentation problems well. 

Embodiments of the invention will be described with reference to the 
accompanying drawings of which: 

Fig. 1 is a flow diagram illustrating a method according to an embodiment of 
the invention; 

Fig. 2 is a diagram illustrating the Hough transform; 

Fig. 3 is another diagram illustrating the Hough transform; 

Fig. 4 is an example image showing man-made structures; 

Fig. 5 is an image showing the results of an edge detection process on the 
image of Fig. 4; 

Fig. 6 is an image showing the result of a Hough transform performed on the 
points in the image of Fig. 5; 
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Fig. 7 is an image showing the results of an inverse Hough transform based on 
Fig. 6; 



Fig. 8 is a graph showing the results of a mapping from Hough space based on 
5 Fig. 6; 

Fig. 9 is a schematic diagram of an apparatus according to an embodiment of 
the invention; 

10 Fig. 10 is a flow chart illustrating a second embodiment of the invention. 

The first embodiment will be described with reference to the example image 
region shown in Fig. 4, which includes a number of buildings, ie man-made 
structures, and the flow diagram in Fig. 1 . 

15 

In this embodiment, the method is performed using a computer, illustrated 
generally by the reference number 200 in Fig. 9, programmed to execute the 
method using suitable software. The computer 200 includes a processor 210, 
image display means in the form of a display 220 and image input means in 
20 the form of a scanner 230. 

As a first step, step 50, a digital image is input to the computer. In the present 
embodiment, the image is input using a scanner 230 scanning a photograph, 
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although other input means may be used, or an image may be retrieved from 
data storage means. 

At step 100, the image is divided into sub-regions. Here, the regions are 
5 blocks of 256x256 pixels. The blocks may be overlapping or non- 
overlapping. In this embodiment, the blocks are non-overlapping and 
adjoining. Fig, 4 shows one block. 

The next step, step 1 10, is the detection of feature points in each block. In the 
10 present embodiment, the positions of feature points of potential interest are 
identified in the image using an edge detector, which identifies discontinuities 
in pixel values. Various edge detectors are known and can be used; in this 
embodiment a Canny edge detector is used. 

15 The edge detection step classifies each pixel in the image regions as either a 
one of feature points or not a feature point and produces a binary image 
accordingly. Fig. 5. is a binary image showing feature points in the image 
region of Fig. 4. 

20 In step 130, the feature points in Fig. 5 are represented in Hough space using a 
Hough transform for line detection. 

A general discussion of the Hough transform follows. 
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Figs. 2 and 3 illustrate the Hough transform. Hough transform is used to 
detect curves that can be expressed in a parametric form. The Hough 
transform projects feature points in image space (Fig. 2) to points in 
5 parameter space also called Hough space (Fig. 3). Each point in the image 
space "votes" for all sets of parameters (e.g. points in the hough space) that 
generate parametric curves passing through that point. Referring to Fig. 2, for 
a point A(x,y), consider one line passing through that point. The 
perpendicular from the line to the origin has a length p and is at an angle 9 
10 from the x axis, and the variables p and 0 define that line in Hough space, as 
shown by the dot in Fig. 3. The Hough transform of a point in image space 
takes all the possible lines passing through a point A(x,y) and plots the 
resulting (p,9) parameter values in Hough space. 

15 Fig. 3 shows the boundaries in Hough space. The horizontal axis corresponds 
to the 9 values which vary from 0 to 2iz, as can be understood from Fig. 2. 
The vertical axis corresponds to the p values and varies between a minimum 
of a and a<>fi in cycles for each %/2 radians, where 2a is the width of the 
block shown in Fig. 2. 

20 

In the Hough transform, each feature point in image space is transformed to 
points in Hough space. Processing of plurality of point in image space results 
in accumulation of points at some p, 9 locations in the Hough space, and co- 



linear points in the image space result in peaks, or local maxima, in the Hough 
space. The local maxima are extracted and then an inverse Hough transform 
is applied to map back into the image space to derive each line corresponding 
to each respective local maximum. The resulting lines are of infinite length , 
and so the lines are combined to get an idea of the shapes corresponding to the 
feature points in the original image space. 

In this specification, the dimension of the Hough space relates to the number 
of parameters defining the parametric curve. Thus, in the case of a Hough 
transform for detecting lines, a point (x, y) in image space is mapped onto a 
point (p, 8) in two-dimensional Hough space. 

Fig. 6 illustrates the result of the Hough transform performed on the feature 
points in Fig. 5. The intensity values in Fig. 6 correspond to the accumulated 
values so that peaks in Hough space are shown as the brightest points (local 
peaks being the locally brightest points). 

In step 140, landmark points are selected. First, the local maxima of the 
accumulator values in the Hough space are detected. Fig. 7 illustrates the 
lines in image space corresponding to the local peaks in Hough space. The 
accumulator values for the local maxima are compared with a threshold. In 
this embodiment, the threshold is a predetermined percentage (80%) of the 
global maximum accumulator value, for the block. The (p, 6) values for the 
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local maxima which exceed the threshold are selected as a subset, which is 
called the landmark subset. The threshold may vary. For example, other 
percentages can be used, and the global maximum may instead be for the 
whole image, or the threshold may be determined in other ways. 

5 

The local maxima in the landmark subset are then processed further, in step 
150. In this embodiment, the (p, 6) values in the landmark subset are 
projected onto the 0 axis and accumulated. This results in a graph as shown 
in Fig. 8 for the present example. The result of the projection is analysed to 

10 determine characteristics about the lines corresponding to the landmark 
subset. More specifically, in this embodiment, the relative angles of the lines 
for the landmark subset are analysed. As can be seen from Fig. 8, the highest 
peaks correspond to prominent directions of 46 and 136°. This indicates a 
large number of lines intersecting at 90°, which suggests a man-made 

15 environment such as urban area. Similarly, a large single peak suggests 
parallel lines which generally occur in a man-made environment. 

Other projections onto other variables could be used. For example, the 
projection could be onto the p axis. 

20 

A second embodiment will now be described with reference to the flow chart 
in Fig. 10. The flow chart in Fig. 10 is the same as the flow chart in Fig. 1, 
except that there is an additional step, step 120, between steps 1 10 and 140. 
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The second embodiment is similar to the first embodiment, apart from 
differences discussed below. 

5 In the step of detection of feature points, step 110, the edge detection in this 
embodiment assigns values indicating whether a feature is present at given 
location, to points in the image. For example, an edge confidence measure 
taking values between 0 and 1 can be used, higher values indicating higher 
confidence in existence of an edge, resulting in a probability map for edge 
10 feature points. Other features can be also used, for example corners or colour 
features. 

In step 120, after step 110, a statistical analysis of the feature points detected 
in step 110 is performed for each block. More specifically, the confidence 
15 values are made into a histogram for each block. Also, the density of feature 
points for each block is calculated. Other statistical information relating to 
the distribution of feature points in the blocks may also be derived. This 
statistical information is used in subsequent processing, in selecting landmark 
points. 

20 

A threshold for detecting landmark points can be derived as follows. A large 
number of randomly selected representative configurations of feature points 
are generated for a given block size. For each configuration, the Hough 
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transform is performed, and a histogram of accumulated values in Hough 
space is determined. The histograms for all the configurations are combined 
(eg averaged) and used to determine a suitable threshold for detecting 
landmark points. 

5 

For example, a value equivalent to the highest value observed in the combined 
histogram may be used as this threshold. 

The combined histogram is a reflection of the image in Hough space arising 
10 from general random image behaviour, in the particular application, eg for the 
specific block size. In other words, this approach gives an indication of peaks 
in Hough space that occur randomly and do not necessarily correspond to 
landmark points in an image, ie noise. The threshold can be varied according 
to the level of confidence required in the landmark point extraction. For 
15 example, a higher threshold, such as three times the highest value in the 
combined histogram, increases the exclusion of landmark points that occur by 
chance, but on the other hand it increases the risk of excluding possible points 
of interest. Similarly, a reduction of the threshold, such as to 80% of the 
highest value in the combined histogram, increases the likelihood of returning 
20 points of interest correctly, but also increases the risk of returning false points. 

Other statistical information as described above can be used in deriving the 
threshold information. For example, the randomly selected representative 
configurations of feature points may take into account the density of feature 
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points for the image region under consideration, that is, they have a similar 
density, and similarly for the other statistical information as appropriate. 

In order to simplify processing, the modelling for generating reference 
5 histograms from the randomly generated images and corresponding thresholds 
can be performed offline and the histograms or threshold values stored, for 
example, in a look-up table. 

The embodiments described above use a Hough transform for detecting lines. 

10 The Hough transform can also be used to detect other regular curves such as 
circles, ellipses, and even in applications where a simple analytic description 
of a feature is not possible, although in such cases the computational 
complexity increases. The invention can also be used in these other 
applications of the Hough transform principle. For example, the invention 

15 could be used in analysing the relationship between the centres of circles, 
where a regular spacing of circle centres suggests human influence. 

The invention can be implemented by any suitable apparatus, such as a 
suitably programmed computer which is either a dedicated application 
20 specific computer or a computer supplied with suitable software to execute 
the method or implemented in hardware such as a specially designed 
integrated circuit. The apparatus may include image input means such as a 
scanner, digital camera, internet link, or a connection to image storage means 
such as a data carrier. 
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Claims 

1. A method of analysing an image comprising performing a Hough 
transform on points in an image space to an n-dimensional Hough space, 
selecting points in the Hough space representing features in the image space, 
and analysing m of the n variables for the selected points, where m is less than 
n, to derive information about the features in the image space. 

2. A method as claimed in claim 1 comprising detecting points for the 
Hough transform using feature detecting means such as edge or corner 
detecting means or colour feature detecting means. 

3. A method as claimed in any preceding claim wherein the analysis of 
the m variables for the selected points involves analysing relationships 
between the selected points. 

4. A method as claimed in any preceding claim wherein the Hough 
transform is for detecting lines and maps a point (x,y) in image space to points 
(r, 9) in Hough space. 

5. A method as claimed in claim 4 wherein the analysis of the selected 
points involves analysing the values of 0. 
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6. A method as claimed in any preceding claim wherein the step of 
selecting points in the Hough space involves identifying local peaks and 
comparing the local peaks with a threshold. 

5 7. A method as claimed in claim 6 wherein the threshold is based on 
random reference images, preferably having similar statistical properties to 
the image being analysed. 

8. A method as claimed in any preceding claim wherein the analysis of 
10 the selected points is for identifying man-made structures and/or for 

distinguishing between urban/non-urban areas. 

9. A method of generating a threshold for identifying features in a 
subject image using the Hough transform, the method comprising generating a 

15 plurality of random reference image regions, for each reference image region 
performing a Hough transform and deriving a histogram of accumulated 
values in Hough space, combining the histograms for the reference images, 
and using the combined histograms to derive a threshold. 

20 10. A method as claimed in claim 9 wherein the reference image regions 
have similar statistical properties to the subject image. 
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11. A computer program for executing a method as claimed in any one of 
claims 1 to 10. 

12. A computer-readable medium storing a computer program as claimed 
5 in claim 1 1 . 

13. Apparatus adapted to perform a method as claimed in any one of 
claims 1 to 9. 

10 14. Apparatus as claimed in claim 13 comprising means for processing 
image signals, means for performing a Hough transform, means for selecting 
points in the Hough space representing features in the image space, and means 
for analysing m of the n variables for the selected points, where m is less than 
n, for information about the features in the image space. 

15 

15. Apparatus as claimed in claim 13 or claim 14 comprising image input 
means. 

16. Apparatus as claimed in any one of claims 13 to 15 comprising image 
20 display means. 
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Abstract 

Method and apparatus for image processing 

A method of analysing an image comprises performing a Hough transform on 
5 points in an image space to an n-dimensional Hough space, selecting points in 
the Hough space representing features in the image space, and analysing m of 
the n variables for the selected points, where m is less than n, for information 
about the features in the image space. 



10 



Fig. 1 



1/6 



[ 



INPUT DIGITAL IMAGE 



T 



S100 



DIVIDE IMAGE INTO REGIONS 



DETECT FEATURE POINTS 



S110 
T 



T 



HOUGH TRANSFORM 



I 



DETECT UN^DcAf^K &<t*rS 
IN THE HOUGH SPACE 

$ 



S130 



SljO 



S150 



PROJECT *-Aaj3><*\MOc. fo irsi^s 
ON HOUGH SlilBSPACE 



i 



S160 



f 



ANALYSIS OF TTtE INTEGRAL 
FEATURE SPACE 



J 



URB AN/NON_URB AN 
CLASSIFICATION 



S170 

i 



2/6 




FIG. 2 




FIG. 3 



3/6 



5 




25 



FIG. 6 



4/6 




FIG. 8 



5/6 




6/6 




S100 



DIVIDE IMAGE INTO REGIONS 



I 



S110 
~~v 



DETECT FEATURE POINTS 



HOUGH TRANSFORM 



i 



DETECT*- AAUX^r < - « ^73 
IN THE HOUGH SPACE 



S130 



SljO 



T 



\j 



PROJECT lA^P O' M *t-i AiT5 
ON HOUGH SIJBSPACE 



i 



S160 



ANALYSIS OF THtE INTEGRAL 
FEATURE SPACE 



S120 
— A 



STATISTICAL ANALYSIS 
OF THE FEATURE POINTS 



URBAN/NON_URBAN 
CLASSIFICATION 



S170 
1^ 



(6 



